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A Primer 
DevOps tools are continuously evolving. 
Here are the essentials you need to know now. 
by Don McVittie 
and Alan Shimel 
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GitHub 


Git is a no-cost source code management version 
control system designed for projects both large 
and small. Git can be used on-premises or as 

a hosted service, one of the strengths of the 
system. Many organizations choose to do both, 
storing some projects on-premises and others 
within the online service. 
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As a commercial remote Git server offering, 
GitHub provides both free and premium services. 
And with a community of more than 26 million 
developers and 72 million repositories worldwide, 
GitHub is a de facto standard. Many other code 


repositories support Git integration and formats. 


A significant advantage to using GitHub is its 
relatively large user base and near-ubiquity. As a 
result, integrations are plentiful. 
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BitBucket 


BitBucket is Atlassian’s hosted, collaborative version control 
service for projects that use Git or Mercurial. As part of the 


Atlassian stack, BitBucket offers in 
offerings such as Jira and Trello. The 


tegration with Atlassian 


Atlassian marketplace also 


features a variety of other integrations. Although they may find 
BitBucket doesn't have quite as many integrations as GitHub, 
developers still likely would find the integration they need. 


BitBucket's strengths include superior scalability and team 


collaboration. Recent additions to BitBUcKet expand on basic 
d edge toward continuous integration 


repository capabilities an 


and other functional areas. One example of increased 
functionality is BitBucket Pipe 
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ines integration to support 


continuous integration and continuous delivery. 


Like GitHub, Atlassian provides tiered 


services. The important d 
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for teams up to five. GitHub, in contrast, does not charge for 


public projects and has n 


O limits on U 


sers if the repository is 


public and/or open source, but charges for private projects 
regardless of the number of users. 
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© HelixCore } Helix4Git 


Perforce Helix 

If you can't beat them, join them. Perforce has 
been in the repository business for more than 
15 years. After years of competing against Git, 
Perforce made the strategic decision to support 
Git with the goal of providing enterprise teams 
additional value. 


Following a number of acquisitions, Perforce has 
expanded the capabilities of its Helix product into 
the software development lifecycle market. For 
those already using Git, the Helix4Git is available 
with Helix TeamHub enterprise. 
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THE HUB OF ENTERPRISE JENKINS AND DEVOPS 


Software at the 
speed of ideas. 


Transform the software that fuels your business with 
CloudBees Jenkins Solutions. 


Your business has amazing, world-changing ideas - the only thing standing in your way is the 
time, energy and processes it takes to turn code into finished product, to transform ideas 
into impact. CloudBees® - the only secure, scalable and supported Jenkins®-based DevOps 
platform - lets you focus on the ideas you want to bring to life, not the challenge of building, 
testing and deploying them, so you can make an impact sooner. 


Get enterprise DevOps automation from CloudBees and allow your team to focus on building 
great software! 


A] DevOps at scale: 3) End to End Visibility: 
(i¢ Your business is critical. CloudBees £05 Get better at predicting what 


takes the frustration of having to features will ship by the drop date. 


wait for build systems, making them Capture metrics across the pipeline 
ready and available. to identify bottlenecks. 

— Build and Deploy in Minutes: Enterprise-grade security: 
Jumpstart your DevOps efforts by CloudBees provides a vetted 
sharing templates across teams and I} version of Jenkins so you can 


deploy effortlessly. lock down sensitive projects 
and ensure compliance. 


To learn more about CloudBees Jenkins Solutions, visit: www.cloudbees.com. 


CloudBees, Inc. 
cloud, 2001 Gateway Place, Suite 670W | SanJose,CA95110 | United States 
ees. www.cloudbees.com | info@cloudbees.com 


‘The registered trademark Jenkins® is used pursuant to a sublicense from the Jenkins project and Software in the Public Interest, Inc. Read more at: www. 


© 2018 CloudBees, Inc. CloudBees and CloudBees DevOptics are registered trademarks and CloudBees Jenkins Solutions, CloudBees Jenkins Enterprise, CloudBees Jenkins Team, CloudBees Jenkins Operations Center, 
CloudBees Jenkins Advisor and DEV@cloud are trademarks of CloudBees, Inc. Other product or brand names may be trademarks or registered trademarks of their respective holders. 


Open source software, like all software, 


changes with each version. Most of 


these changes evolve the software and 
enhance its capabilities, performance or 
security. Sometimes, however, changes 
can introduce errors and security defects. 
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This is where artifact repositories come in. 
Artifact repositories provide organizations 
an authoritative source for current and 
approved versions of a module, library or 
other artifact. Artifact repositories also 


e€ organizations to revert back to the 
nown trusted and approved version 


when undesirable software is entered into 


a Sys 
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ct repositories support both internal 


and externally developed artifacts so teams 


have 


consistent access to all necessary 


modules, libraries and other artifacts. 
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Sonatype Nexus Reposit 
source — especially Java 


Sonatype 
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-based and Maven- 
built — artifact and component storage and 


management. When it comes to security, the 
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ory has a strong 


heritage 


and helps ensure an orga 


latest and vulnerability-free versions. 
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JFrog Artifactory 
Artifactory is a widely used software artifact 
repository. Much of its popularity is due to its 
ability to integrate with many toolsets in the 
DevOps and continuous integration and delivery 
stacks. Artifactory is integrated with a wide 
selection of DevOps tools, making them applicable 
to a variety of toolchains. 


JFrog has its repository roots in an RDBMS format, 
but has grown beyond those roots. Sonatype 

has its roots in the Maven repository format 

but has also grown beyond those roots. Today, 
both support an array of repository formats, and 
users increasingly want specialized repositories 
that meet the needs of their other tools, so 
Docker repository support, or Maven repository 
support, based upon the rest of the architecture. 
Organizations should pay special attention 
during any evaluation to see which better fits the 


organizations’ specific environment. 
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Integration 
Servers 


Continuous integration (Cl) servers are 
the point of entry for many new DevOps 


organizations. As an extension of agile, Cl 
servers enable automated build and test, 
along with varying levels of notifications 
fundamental to keeping agile efforts on 
track. The open source project Jenkins® 
tracks active installations, for example, 
and (at press time) boasts 153,000 active 
Jenkins installs. While Jenkins is by far 
the most dominant Cl/CD server in terms 
of market share, the number of active 
installations and users (estimated at more 
than 15 million) are indicative of a healthy 
market. 
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Additionally, many Cl tools have added 
continuous delivery (CD) capabilities. The 
differences between continuous integration, 
continuous delivery and application release 
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automation (ARA) continue to blur. 


Jenkins 


Jenkins 

If there is one tool that the vast majority of DevOps teams have 
deployed, it is Jenkins. There are other tools, but Jenkins is the 
“Got DevOps?" standard. If Jenkins has a problem, it is one of 
abundance. The Jenkins plugin category is an embarrassment 
of riches: As many as 1,500 different plugins are available for 
Jenkins. 


Certainly, Jenkins has taken steps to make plugin selection 
easier for its users, but the first thing every new user asks is, 
"Which plugins do | need?" Short answer: As few as possible. 
Especially at first. Start with a source code management (SCM) 
repository plugin (GitHub, BitBucket or Local Git, for example) 
and another plugin for builds (Gradle or Maven, for example). 
More can be added later, but starting light keeps the build/test 
environment simple and manageable, and doesn't load down 
Jenkins with unnecessary plugins. 


Jenkins 2.0 also includes Jenkins Pipeline and a friendlier 
interface (Blue Ocean). Managed Jenkins and other enterprise 
features are available from CloudBees Jenkins Enterprise. 


CONTINUOUS INTEGRATION SERVERS 


Visually create CD pipelinesin #& 
minutes & automatically deploy 
apps — all with one tool. 


With Puppet Pipelines, you can standardize your software 
delivery pipelines from development to deployment — 
across servers, VMs and containers, on any cloud 

and on-premises. 
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CircleCl 

CircleCl could be a good choice for those looking for a quick, 
inexpensive Cl tool to get started with. Its emphasis on easy 
setup and ease of use makes it a simple choice for those 
starting out. Like other offerings, it is available as both a cloud 
instance and a local installation. It doesn't have the breadth of 
integrations or plugins as others, but if simplicity, lean and fast 
uptake are important, CircleCl is worth considering. 
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GitLab 

The open source version of GitLab has more than 80,000 
active instances, while the GitLab Enterprise Edition has SOO- 
plus paying enterprise customers. GitLab is well-documented, 
easy-to-use and extensible. Users has complained it suffers 
from poor alerting and notifications, but for those enterprise 
teams seeking an affordable option to Jenkins, GitLab is 
worth a look. 
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Travis Cl 


Travis Cl 

Travis Cl is representative of hosted Cl services. 
Because it is hosted and has fewer configuration 
steps, it is generally simpler to set up than 
Jenkins. However, the edge gained from simplicity 
is lost as projects grow and configuration files 
become more complex. Open Source projects 
often use Travis Cl because it is free for such 
projects, and users don't have to maintain the 
hardware and software that Jenkins requires. 


Choosing between a hosted or on-premises 
system often varies from project to project 
and even team to team. A team that is small 
and pressed for time might appreciate Travis Cl 
because it replaces one server from the build 
chain with a service, and those just starting out 
might appreciate the simple setup while they 
decide what best suits the team’s longer-term 


goals. 
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thas been said that “if DevOps is the 
symptom, continuous delivery is the 

cure.” Automation and agile gave rise to 
continuous integration; the next logical step 
is continuous delivery. Many of the Cl tools 
previously mentioned are also in continuous 
delivery. Additionally, many CD vendors are 


also in the application release automation 


market. 


Where does continuous delivery fit in the 


as 
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CI/CD continuum? Continuous delivery 
is the extension of agile to build and 

test processes, continuous Ccelivery is 
delivering software more often through 
use of DevOps methods. The composite 
of both is the core of application lifecycle 


management (ALM) in DevOps. 


IBM UrbanCode 

UrbanCode was an early DevOps 
favorite. After IBM acquired UrbanCode 
nc., some of its small-company and 
open source aura faded. To IBM's credit, 
the company continued providing 
new UrbanCode functionality. Today, 
UrbanCode Deploy and UrbanCode 
Release together offer widely used 

CD and application release automation 
toolsets that integrate with Jenkins for 
continuous integration. 
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Atlassian Bamboo 

Another too! within the Atlassian stack 
is Bamboo. Bamboo is deeply integrated 
with Atlassian products; it doesn’t have 
as many integrations outside of the 
Atlassian stack as competitors. Outside 
of its own product stack, Atlassian has 
focused on integrations that are more 
popular, so many environments will find 
what they need. Organizations using or 
considering BitBucket, Jira and HipChat 
should seriously consider Bamboo. 
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CloudBees Jenkins Solutions 
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their Jenkins solutions help enterprises implement 


and scale CD fa 


adopt CD quic 
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ster. Jenkins and CD pipelines 


can be centrally managed to ensure teams can 
y and flexibly while still adhering 


to company process and security standards. 
CloudBees Jenkins Solutions extend the Jenkins 


CONTINUOUS DELIVERY 


user interface to enable onboarding of teams and 
projects with just a few clicks. 


Jenkins has +1500 plugins enabling integration to 
virtually every DevOps tool, however some users 
find the sheer number of integrations to present 
a compatibility challenge. CloudBees solves this 


problem by rigorously testing plugins for quality and 
interoperability, making adopting new functionality 
and upgrading much easier. 


As continuous delivery becomes increasingly 
business critical, it is important that the CD tools 

are resilient and well supported. In fact, many 
organizations have begun to apply production 
service level agreements to the CD tools. CloudBees 
Jenkins Solutions support this by providing 24/7 for 
Jenkins and CD, so you can reliably deliver better 
software faster. 
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Recently, CloudBees extended its solution offerings 
with CloudBees DevOptics®, providing a holistic view 
of the entire DevOps process through Value Streams. 


CONTINUOUS DELIVERY 
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CodeShip 

Codeship® by CloudBees helps engineering teams to test 
and deliver their software in the cloud, fast. No matter the 
architecture or application type, Codeship has you covered. 
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Codeship's products offer a turnkey, ready to go Cl/CD 

environment that adapts to your teams’ needs and helps you 
set up Continuous Delivery for your cloud applications. From 
simple, standardized workflows to very complex applications 


and requirements. 


Additionally, Codeship offers excellent support for the container 
ecosystem helping you test, build and deploy your Cloud 
Native/containerized stack by being able to leverage the 
environment configuration you already have in place. 
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For software delivery, these are the most PLUTSRA. 


common questions you hear: 


When will the 
release go live? 


How much risk is 
involved with this release? 


What is the quality 
of this release? 
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of enterprises to Use 


application release automation by 2020, up 
from 15 percent today. 


OpenMake 


Software Meister 


DeployHub 


OpenMake Software 

OpenMake offers DeployHub Pro, a continuous delivery 
solution based upon the open source DeployHub product 

With agentless deploys, interfaces to the most common 
DevOps tools and multi-platform support, it has much to 

offer the modern enterprise. OpenMake also offers Meister, 

an automated build tool that integrates with an array of 
development tools, including a massive selection of compilers. 
Meister claims to improve compile times by 95 percent, which is 
impressive in environments that have large code bases. 


The strength of DeployHub is definitely its open source roots 
and agentless operations. The ability to grab the source and 

see what is going on, combined with the ability to deploy 
applications to a wealth of targets (including Cisco routers), 
make it a promising choice for complex environments that lean 
toward open source solutions. Support via the open source 
project is actually pretty solid, with some of the best OSS 
documentation we've seen combined with an active community 
responding to requests. 


APPLICATION RELEASE AUTOMATION 


The strengths of Meister are just-in-time build dependencies 
that shorten the amount of time spent rebuilding objects and 
parallel processing for builds. A good secondary strength is 
server pooling for Jenkins builds. 


The ability to have a single central build tool for hundreds 

of different compilers on a variety of targets is useful to an 
enterprise that has grown organically. It is rare that the current 
standard dev language is the only language in use, so broad 
compiler support is key. 


Between the two, build and delivery of applications are covered 
with a combination of open source and commercial applications. 
OpenMake is worth evaluating for organizations with a complex 
programming language environment and a desire for an 
agentless deploy syst 


LEM. 
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XebiaLabs 


XebiaLabs 

XebiaLabs provides two ARA tools: XL Release, 
for managing development, and XL Deploy, for 
managing operations. Building the application 
and installing to the environment are effectively 
managed by both products. Like others here, 
XebiaLabs bridges the gap between build 

and deployment tools. Users can map what 
resources are required for a deployment and 
target that specific deployment to a predefined 
infrastructure. The ARA processes are 
repeatable and reduce manual intervention and 
associated errors. 
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The future of 
Software Releases 


Try a Sandbox 
DeployHub.org 


>" puppet 


Puppet Pipelines for Applications 
Puppet Pipelines for Applications simplifies 
application delivery, providing continuous 


delivery and 


release aut 


omation from every 


commit to every deployment. Puppet's ARA too! 
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role-based access control for more governance. 
Perhaps the greatest feature of Pipelines for 
Applications is that it works with any cloud or 
on-premise application and you can visualize your 
software delivery pipelines all in a single place. 
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Electric Cloud 

Electric Cloud provides ARA tools that are 
comparable to the other tools listed here, with 

one feature some will find useful. Electric Cloud's 
Electric Flow offers the ability to customize the 
user interface for business users, making it easy 
for those who are not so technical to monitor their 
projects. 


Business users who want regular status 
Updates may want to consider the Electric Flow 
dashboard, which ties progress to their internally 
defined business goals (as opposed to agile task 
completion or story completion). There are many 
other features to consider as well. 


While many ARA tools look quite similar (and 
there are a lot of tools to consider), identifying the 
differentiators among each is worth the time. 


APPLICATION RELEASE AUTOMATION 


Ca. Automic’ 


technologies 


CA Automic 


Like all ARA tools, Automic sits between your 
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tools be 
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CI/CD processes and your deployment s 
melding them into a complete DevOps toolchain. 
And like every other ARA tool, Automic supports 
that are the current cost-of-entry 
into the ARA market. It a 
tools, which is one of its strengths. 
Automic had good and g 
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PM and line-of-business sponsors like the rollup 
reporting environment that Automic offers, while 
operations staff likes the breadth of tool support. 
About the only common complaint involving the 


> 


product is its lack of support for a variety 
of scripting languages for customization — 
a complaint hardly unique to Automic in the 
DevOps world. 


Available plug-ins for Automic are included in 
the Automic Marketplace. AUtomic is well on its 
way to providing out-of-the-box support for the 
majority of Dev/DevOps toolsets, and those it 
doesn't support can be integrated via its scripting 
language and/or APIs. 
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infrastsucture 
Automation 


Infrastructure automation is the 
process that automates, largely through 
scripting, the installation, configuration 


and management of servers. It’s often 
called infrastructure-as-code because 
nfrastructure automation is the ability 

to define infrastructure and workload 
configurations as sets of scripts that 

can be applied to either a single server 
instance or thousands of servers. DevOps 
has made infrastructure-as-code tools 
popular and has helped to mat 


ture these 
implementations. For example, launching 
an application with a web/API server and a 
database server with all of the networking 
and supporting applications could be 
scripted and run as needed. 
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Chef 


Chef is the elder statesman of infrastructure-as- 
a-service (laaS) automation. Using Chef, machines 
can be defined in scripts, which can be used to 
ensure the configuration of those machines are 
exactly the same every time. This is useful not just 
for systems operations but also for deployment, 
because Chef makes deployment failures easier 
to debug. If the Chef script works one day but 
doesn't work the next day, a quick look at what 
changed in the script Usually will resolve the issue. 
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AWS Opsworks 

Large cloud vendors follow an API-first development 
methodology. This means that APIs are available 

for tasks ranging from “launch a server" to “create a 
route.” The existence of APIs for all infrastructure in 
a Cloud makes the cloud particularly well-suited for 
DevOps infrastructure management. 


AWS Opsworks originally was a private-labeled Chef 
implementation for Amazon Web Services. It was built 
to use Chef and APIs to get AWS-tested or -hosted 
cloud environments online and running quickly. 

While most infrastructure automation tools support 
the major cloud providers, Opsworks is optimized 
specifically to deploy and manipulate AWS objects. 
Out of the box, Opsworks includes Chef functions 

for AWS-specific deployment needs, relieving teams 
fram having to cobble something together. 


Recently Puppet announced enhanced functionality 
with Opsworks. It remains to be seen whether 
Opsworks will evolve into a standalone too! 
independent of its Chef roots. 
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SaltStack 


Similar 


SALTSTACK 


in design to Chef, SaltStack Enterprise 


is more focused on compliance and security 


for the 
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enterprise. As with most infrastructure 


orchestration and automation tools, SaltStack 
supports application installation and automation 
and can manage the entire deployment stack 


regard 


£ + 


rastructure. If managing 


ess of the target in 


the entire deployment stack is necessary, 

but security and compliance are priorities, 
SaltStack can answer both needs more readily 
than competitors that have focused more on 
infrastructure and application deployment than on 
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securit 


y and compliance. 
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HashiCorp 


‘yw Terraform 


Terraform 


Terraform 
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tools that 
center. To 


that task. 


is designed to automate the entirety 


of the data center. While it has the same aim 
as SaltStack Enterprise, it approaches the task 
differently. Terraform is designed to manage the 


would normally automate the data 
automate a task, Terraform typically 


issues a request to the tool that specializes in 


For example, Chef may be called to 
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servers. It 
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this is a to 


manage servers, while Puppet might be called to 


configure the applications on those 
takes a lot to orchestrate every bit of 


infrastructure, and Terraform is a complex system. 
But for those that have the time and intend to 


hly portable, highly flexible data center, 
ol worth considering. 
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Ansible 


Ansible is different from Puppet in that it is agentless. 
Ansible can be set up and running without installing 
software on each machine. This speeds time-to-value 
for Ansible users. Also, Ansible uses the human- 
readable data-serialization language YAML to define 
installations. Different users find this to be either a 
plus or a minus when compared to Puppet Script, and 
since writing scripts is a big part of both tools’ usage, 
it is worth determining the organization's preference. 


ota 


Also since its acquisition by Red Hat, Ansible now 
offers tighter integrations to the Red Hat Enterprise 
Linux (RHEL) stack that could make it a favorable 
selection. 


For organizations that have yet to adopt deployment 
automation, it is worth the effort to look at all the 
deployment automation tools and determine which 
will work best for their enterprise. Many of these 
automation tools are also capable of providing either a 
complete Cl, CD and ARA pipeline or integrations with 


popular tools in that area. 
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Enterprise IT environments are amazingly 
complex. Even before DevOps came along, 
most enterprises had several development 


languages, platforms, reporting tools, test 
environments and more. DevOps introduced 
a new set of tools — some that span this 
complexity, some that increase it. For 
organizations with dozens of application 
development teams, there are likely just as 
many architectures for build/test/deploy. 
And often they are interdependent, as 
applications require integration with other 
projects or platforms. 


PLUTORA. 


Plutora Platform 

Plutora is one of a few organizations that sees the problem of 
continuous delivery management and attempts to address it. It offers 
a software-as-service (SaaS) based continuous delivery management 
platform, with four different tools that all aim to help an organization 
with one goal: to make the complex world of enterprise development 
more manageable. 


Plutora Release brings operational visibility into complex, multisystem 
releases. Plutora release works to open up visibility of the delivery 
pipeline from inception to deployment. Beyond defining the 
release with its associated features, environments and calendar, it 
allows for development phases (eq. sprints) and associated gating 
criteria in order to move to the next phase. For example, gates can 
mix both manual and automated criteria to ensure quality goals, 
documentation/regulatory requirements, and code coverage 
equirements. The idea is to offer a unified platform for managing 
software delivery across disparate systems and teams. 


Plutora Environments aims to make provisioning of test environments 
easier. Allocation of test environments for complex systems can 

be the bottleneck that holds up the entire build stack. Plutora 
Environments aims to ease this by offering a booking system that 
coordinates management and configuration of pre-production test 
environments. 
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Plutora Deploy attempts to address deployments that can span not 
just systems and platforms, but geographies also. Plutora Deploy helps 
users create a “go live" plan with both automated and manual steps to 


ensure the entire system rolls out as expected, when expected. 


Plutora Test is a complete test management solution that doubles as 


a centralized clearin 


enable test teams to influence testin 


ghouse of test metrics and information. It readily 
synchronizes data with Jira and a sui 
the results across the environments. 


as 


te of automation tools gathering 


eal-time traceability matrices 
g activities from unit test created 


in development all the way to exploratory testing done on staging and 


production. 


Taken as a whole, the 
management toolset. 


Plutora Platform is a department-spanning 


However, it's likely a given organization will start 


with a single tool before considering 


particularly ones that 


bring control and visibility to all Test/ 


span geographies, Plutora Platform useful to 


the others. For large enterprises, 


Release/Deploy functions. The 


benefit to DevOps is integration with DevOps tools and reducing the 


extra complexity those DevOps tools introduce. 


Note that Plutora is 100 percent Saas. This means accessibility from 
multiple locations to the same data, but for some organizations might 
be a cause for concern with the information these tools will require. 
Suitability to environment is always a key thing to check, and Plutora 
is best aimed at complex environments that are comfortable with 


SaaS solutions. 
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DevOps teams rely on log management 
o better run their environments and 
organizations. Without a log management 
ool, it can be difficult — if not almost 
impossible — to manage and analyze the 
volume of logs in most environments. 


through either au 


dentifying trouble spots 
tomation or search is 


essential. There are many tools available 


that help with log 


management, monitoring 


and alerting. According to Markets and 
Markets, the APM space is expected to 
row 12.86 percent, compounded annually, 
to reach $4.98 billion in 2019. 
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Splunk 


When it comes to log management 


Splunk is the go 
tremendous volumes of logs and 
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log searching and automa 


log search and analysis capabilities. Splunk’s 
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and analysis, 


d standard. Splunk can aggregate 


offers advanced 


ted analysis assists 


organizations in reducing the amount of time 

in finding what went wrong, enabling them to 
remedy problems more swiftly. Splunk historically 
has been on-premises, but the company also has 
a hosted option called Splunk Cloud. 


One of DevOps' objectives is to shorten IT 


task turnaround times. Searching 


throughout 


an enterprise for logs to correlate events and 


determine root cause can be, in a 


word, painful. It's 


also time-consuming. Splunk and tools like it aim 
to make such tasks faster and easier. 
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SumoLogic 

SumoLagic is a cloud-hosted log manager. 
Similar to Splunk in concept, SumoLogic runs on 
someone else's servers, which may be a plus or a 
minus depending on the organization. SumoLogic 
is a cloud-hosted service, but it also provides for 
local usage. 


= SCALYR 


Scalyr 
Scalyr also looks and feels like Splunk. Its pricing 
is generally more predictable and less costly 
than Splunk's pricing, and Scalyr uses that as a 
reason to consider its offering. Scalyr also points 
out its performance and unlimited log growth as 
additional reasons to consider its technology. 
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ExtraHop 


ExtraHop provides visibility into communications across an 


ne bottlenecks. ExtraHop can 


infrastructure and helps determi 


reconstruct failed data flows to find the source of a problem and 


creates a picture of the infrastru 


the network. For quality assuran 
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Datadog 


cture taken from a perspective 


many enterprises don't have the ability to see: data flows across 


ce and test teams, ExtraHop 


captures what is actually happening in the environment to 
augment the test results. ExtraHop is particularly suitable for 
complex or high-performance environments. 


Datadog monitors all aspects of the software infrastructure so the 
DevOps team sees what's happening with specific components. 
With roll-up results and built-in application performance 


management, Datadog helps to determine what is happening 


within a complex environment. While ExtraHop analyzes 


networking streams to offer perf 


ormance and problem-resolution 


information, Datadog offers similar information but from the 


perspective of what is happening inside of the software. 


MONITORING 


SignalFX 

SignalFX is a tool similar in many ways to 
Datadog, with an agent that collects local data 
and reports that data to SignalFX for processing 
and presentation in a dashboard. Where SignalFX 
is different is in custom data — the data a given 
application or team deems important but isn’t 
normally collected. That data is sent directly 


+ 


to SignalFX, whereas in Datadog it is sent to 
the agent, and bundled along with the other 
collected data. For environments with intermittent 
connection issues, Datadog might be a better fit 
For environments where a lot of different custom 
data is collected, SignalFX may be a better choice, 
simply because the tool reports data directly 
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to the hosting servers with no middleman. This 


makes it easier to track lost data and identify 
incorrect custom data. 
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No matter the monitoring tools and 
processes, a tree falling in a forest that 
no one hears fall doesn't help DevOps 


teams deliver. The DevOps market has 


seen several alerting platforms evolve 


that free the admin from the NAC, but 
allow for teamwide 24/7 communication 
response. The hallmark of these 


and 
too 


S iS a wide integ 


ration footprint with 


as Many monitoring tools as possible, as 


wel 


as the widest p 


ossible means to alert, 


communicate and remediate incidents. 


® VictorOps 


VictorOps 

VictorOps hopes to change the way DevOps team 
members interact with systems and users. The 
current iteration aims to help improve incident 
visibility and cross-team communications by 
providing clear, understandable information to 
those working outside their discipline, such as a 
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developer troubleshooting network issues. 


VictorOps enables both broad and targeted 
communications of status and issues. Providing 
more information to team members who 
otherwise might not be aware of event details can 
aid problem resolution significantly. 
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PagerDuty 

PagerDuty grew from an automated paging 
system to providing full incident response, 
including artificial intelligence-aided automated 
response. It can take considerable effort to 
correctly configure support team members, 
call schedules, escalations and other related 
aspects of incident response, but once 
configuration is completed, PagerDuty helps 
streamline incident response. 


eS OpsGenie 


OpsGenie 

OpsGenie is a less costly alternative to PagerDuty 
and VictorOps. While their feature sets are 

similar, each has differences that could matter 
considerably to some environments. It's worth 
looking at all three before making a decision. 
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ChatOps originally described the use of 
APIs to embed chat tools into systems 
alerting. Vendors identified customer 

need and some started integrating chat 
Capabilities into the DevOps toolchain 

to facilitate systems management and 
troubleshooting. Today, using ChatOps, it 

is possible to check in code changes and 
inform teams of the results, helping resolve 
problems quickly. 


4 slack 


Slack 

Slack is the ChatOps standard. Teams originally 
integrated Slack into their DevOps practices as 3 way 
to offer quick communications, and later for systems 
notifications. Today, Slack has more than SOO 
integrations, including many of the tools discussed in 
this report. Slack provides rapid notifications, the ability 
to save select conversations to cloud-based storage, 
automation of DevOps tools based on channel activity 
and more. Slack’s API makes incremental integration 
creation a straightforward process. 
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HipChat 

HipChat is the communications channel underlying 

the Atlassian platform. As such, organizations heavily 
standardized on Atlassian prefer HipChat over other 
ChatOps offerings. HipChat offers advanced capabilities 
within the Atlassian tool stack, and third-party 
integrations and an API for customization are available. 
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Flock 

Flock is a less-expensive Slack alternative. However, 
it does not have the number of users or the depth 
of integrations. With an API, theoretically anything 
can be integrated with Flock; it just takes time. 


The tools mentioned here are currently battling it 
out when it comes to features and cost. Research 
is warranted, as the market is rapidly evolving. 
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DevOps organizations have been slow to 
add database support and management 
into their toolchains. But if code is changing, 
itis almost guaranteed that databases 


a 


are, too. The vendors below help fold the 
database into the DevOps practice. After all, 
sooner or later, the database needs to be 
included in DevOps simply because most 
apps rely heavily on data. But databases are 


not terribly mobile, which makes targeting 
databases to new platforms more difficult. 
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Database configuration and automation 
tools are relevant to DevOps database 
management because agile applications 
still need help getting to existing data. And, 
in some use cases, the database actually 
is mobile, or a new empty instance can 
be launched on demand without loss of 


application functionality. 


DBmeestro 


DevOps for Database 


DBMaestro 

DBMaestro's twin products, Database Source 
Control and Database Release Automation, 
combine to offer Cl and CD functionality to the 
database. By creating a source-controlled single 
point of authority, and then a tool to build and 
release the database defined by that single point 
of authority, DBMaestro brings DevOps to the 
database. 


There are features that emulate the merge 
functionality of source control management 
offerings, which helps avoid the loss of new 
columns or attributes when two competing 
changes are made. 


DBMaestro is worth considering when moving the 
database to a more agile footing — or straight into 
DevOps. 
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Datical 

Datical enables database as code, automating 
the database change and deploy process — 
the same way other codebases are managed. 
In environments where new instances of the 
database are launched or where datasets 

are mobile, defining the database as code 
standardizes data stores across instances and 
even architect 


LULES. 


redgate 


RedGate 

RedGate provides a selection of tools that 
facilitate SQL Server deployment, test, monitoring 
and troubleshcoting processes. Although it applies 
specifically to SQL Server, RedGate's toolset is 
comprehensive. Companies with Microsoft data 
architectures might want to consider RedGate. 
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many containers (clustering) and 


another that makes each server into a “pod" 


that wil 


run related containers. 


kubernetes 


Kubernetes 
Kubernetes is the most used container 


manag 
manag 


be assi 
machines increases scale, and each machine 


manag 


ement tool in the enterprise. Kubernetes 


es individual machines as entities that can 
gned multiple containers. Simply adding 


ls 


es internal tasks such as routing and 


scheduling. 


With Kubernetes, a collection of containers can 


be run 
can be 
manag 


ey 


as services (Servers, databases, etc] and 
Called upon when needed. Kubernetes 
es routing between machines or groups 


of machines, and auto-scaling adds resiliency to 
the infrastructure by scaling instances as user- 
defined thresholds are met. 
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Mesos and DC/OS 


Mesos and its commercial descendant DC/OS 
take a different approach than Kubernetes to 
container management. Servers are joined to 


the Mesos cluster, and the cluster 


is presented 


as one large computer with jobs distributed 

across underlying systems. Recently, DC/OS 
has added Kubernetes support, which means 
that a Kubernetes instance (or three) could be 


running on a DC/OS cluster. This e 


nables different 


versions of Kubernetes to run as n 
introduces another layer of manag 
staff will have to maintain. The trad 
with managing another layer of 


eeded, but 
ement that 
eoff associated 


software might 


be worthwhile for organizations that need to run 


multiple, concurrent versions of Ku 


bernetes. 
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Docker Enterprise (Swarm) 

Docker Enterprise Edition is the container 
management tool offered by popular container 
vendor Docker. Originally a competitor to 


Kubernetes, Docker Enterprise has been 
positioned as more secure by default than 
Kubernetes. Eventually, as Kubernetes and its 
commercial variants took over the enterprise 
container management space, Docker began 
offering Kubernetes as an option for deploying 
containers, along with Docker's security and 
management. 


Because Docker containers are the standard for 
system level images, Docker Enterprise will see 
some amount of success. The additional security 
protections offered are not well-matched by other 
competitors, but as we've seen across DevOps, 
that can change quickly. 


Docker Enterprise Edition is worth a look. 
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Serverless grew out of the microservices 
movement. In microservices, an application is 
broken into smaller pieces, each of which rely 
heavily upon internal APIs to communicate. 
Serverless takes this concept of independent 
pieces tied together by an API one step further, 
making each logical function into an API- 
interfaced independent entity. By breaking the 
code up in this manner, serverless then services 
requests to a given API on demand. If no requests 
are incoming, nothing is running. If many requests 
are incoming, many instances of that particular 
API may be servicing requests concurrently. The 
appealing element of serverless is also how it gets 
its name: The API is not tied to a given server. And 
while it will be spun Up when it is run to respond to 
a given request, where it runs is not important to 
the completion of the API. 


Serverless is still new and it is questionab 
whether it will find broad use in enterprise 
applications. Already, though, there are good use 
cases for serverless, including cloud-bursting for 
spikes in application usage. When bottleneck code 
is placed in a serverless environment, scaling of 
that code happens automatically. Since use cases 
exist that make sense for serverless, it will likely 


find a home in the agile and DevOps toolboxes. 
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nce serverless technology is still young, 


oe 


ere are not yet prominent tools. Indeed, each 


serverless implementation is unique — which 


eans there is no portability between serverless 


vendors. All of the toolsets currently provide 


nctionality such as application firewalls, 
qgered invocations, REST APIs and the ability 


to 


connect to back-end services. Still, one 


useful — perhaps determining — differentiator 


iS 


where serverless functions can run. At Some 


organizations, some functions need to be in- 
house. That means the ability to deploy serverless 
internally or externally must be considered if 
certain applications can't go to a public cloud. 
Current vendors include Google CloudFunctions 
(currently in beta), OpenWhisk and AWS Lambda. 


SERVERLESS 


Conclusion 


The maturation of DevOps guarantees new tools 


will continue to emerge. We've offered a cross- 
section of useful tools for enterprise DevOps 
teams. It is By no means an exhaustive study, 
but rather a good jumping-off point. Of course, 
an organization's mileage may vary depending on 
its own needs. While exact toolchains for given 
project teams or enterprises will vary, the tools 
from each of these categories are all essential to 
automating the application life cycle and DevOps 
SUCCESS. 
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